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ACQUISITION AND ORGANIZATION OF DIGITAL IMAGES 

Background of the Invention 

5 As the availability of inexpensive, photographic-quality computer printers has 

increased, there has also been an increase in the popularity of digital photography. Images 
can now be captured and printed with a quality that rivals those of traditional 
photographs. Many digital cameras automatically capture photographic images at the 
push of a button, storing them electronically in the camera on a memory device such as a 

10 flash card. The digital images can be uploaded to a computer. Large numbers of digital 
images can then be efficiently stored on media such as writeable or rewriteable CD-ROMs. 

In addition to digital images captured by digital cameras, many users also use 
products incorporating optical scanning technology to create digital images from 
traditional photographs or other print media. One popular type of these products are 

15 multifunction (also known as " All-in-One") printers which typically include scanner, 

copier, and in some cases fax capabilities in addition to printing capabilities. To perform a 
scanning operation, image acquisition systems incorporating these products typically 
require the user to manually select or adjust a number of settings, usually in conjunction 
with a preview of the image to be stored, before the digital image of the scanned item is 

20 created. 

As large- numbers of digital images from different image sources are acquired, it 
becomes both more important and more difficult for the user to manage and organize 
these images in a manner that allows him or her to easily locate and access desired images. 
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Accordingly, it would be highly desirable to have a new and improved image 
processing system, and methods of scanning and organizing digital images, that more 
easily acquire images from optical scanner products and which organize images from all 
sources in a convenient manner. 

Summary of the Invention 

In a preferred embodiment, the present invention provides a method of organizing 
digital images automatically. When a digital image is acquired, it is automatically 
converted into a data file with an associated date, and stored into a file system folder 
associated with that date. In another preferred embodiment, the present invention 
provides a method of optically scanning a target item automatically by using predefined 
scanner settings appropriate to a photographic image to scan the item. 

Brief Description of the Drawings 

The above-mentioned features of the present invention and the manner of attaining 
them, and the invention itself, will be best understood by reference to the following 
detailed description of a preferred embodiment of the invention, taken in conjunction with 
the accompanying drawings, wherein: 

FIG. 1 is a block diagram of an image processing system according to the present 
invention; 
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FIG. 2 is a perspective view of the image processing system of FIG. 1 illustrating a 
variety of image sources; 

FIG. 3 is an illustration of an exemplary computer monitor display generated by 
the image processing system of FIG 1; 

FIG 4 is a flowchart of a method of automatically organizing digital images usable 
with the image processing system of FIG. 1; 

FIG. 5 is a perspective view of a multifunction printer usable in the image 
processing system of FIG. 1; 

FIG. 6 is a more detailed flowchart of the image acquisition portion of the method 
of FIG 4; and 

FIG 7 is a schematic representation of image acquisition parameters associated 
with the image acquisition method portion of FIG6. 

Description of the Preferred Embodiment 

Referring now to the drawings, there is illustrated an image processing system 
constructed in accordance with the present invention which automatically converts an 
acquired digital image into a data file having an associated date, and stores the data file in 
a file system folder associated with that date. As best understood with reference to FIG. 
1, the image processing system 10 includes at least one image source 20a-b ? an image 
capture subsystem 30 coupled to the image sources 20, and a file system 40 coupled to the 
image capture subsystem 30. In operation, the image capture subsystem 30 requests, and 
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one of the image sources 20 provides, at least one digital image. The image capture 
subsystem 30 associates a date with each digital image and automatically converts each 
digital image into a corresponding image file. The image capture subsystem 30 then 
automatically stores each image file in the file system 40 in a data folder which is 

5 associated with the date. The present invention advantageously makes it easier to locate 
digital images, handles images from all image sources in a similar manner, and provides a 
similar user interface for all image sources. 

Considering now in further detail the image source 20, and with reference to FIG. 
2, the image processing system typically includes a computing apparatus 2 to which the 

10 image sources are coupled over a communications interface 4. The communications 

interface 4 may be a different physical type (including, for example, serial, parallel, USB, 
DEEE1394 "Firewire", or the like) and may utilize a different standard or proprietary 
communications protocol for different types of image sources. The image source may be 
the image recording subsystem of a digital camera 21a, or may be the prerecorded image 

15 memory of a digital camera 21b. The prerecorded image memory is typically a flash 
memory device which is preferably removable from the camera 21b. The flash memory 
device may be a SmartMedia (trademark of the Solid State Floppy Disk Card Forum) 
device, a Memory Stick (trademark of Sony) device, a CompactFlash (trademark of the 
CompactFlash Association) device, or the like. The image source may also be a memory 

20 card reader 23 into which the memory card 22 is inserted. Such a card 22 preferably 

contains a file system, and the card 22 and reader 23 combination preferably implements a 
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communications protocol such as the Mass Storage Device Class protocol or the like for 
the transfer of digital images to the computer 2. The image source may further be an 
optical scanner 24. The scanner 24 may communicate with the computer 2 using TWAIN 
protocol (version 1.9 of the protocol definition is available at http://www.twain.org) or a 

5 proprietary protocol The image source device may additionally be a multifunction printer 
25. Such a printer 25 preferably includes an optical scanner subsystem, which may also 
communicate with the computer 2 using TWAIN protocol or a proprietary protocol. 
Some printers 25 further include a memory card reader subsystem, operable as previously 
described for the memory card reader 23. A memory card reader subsystem may also be 

10 included in computer 2. Other types of image sources capable of providing digital images, 
such as video source 26, may also be connected to the computer 2. Video source 26 may 
be a video capture subsystem which converts an analog video signal into digital format, or 
may be a digital video device such as a DVD player, a digital camcorder, or the like. Any 
combination of these types of image sources 20 may be included in the image processing 

15 system 10, and the system 10 may contain more than one image source 20 of the same 
type. 

The image processing system 10 may further include devices to which a digital 
image captured from an image source 20 can be sent. Such devices include a printer 6, 
which may be of any type capable of printing an image but which is preferably a color 
20 inkjet printer, and a communications interface (not shown; typically included in computer 
2) which provides a connection to a network 8. The network 8 may be the telephone 
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system for sending a fax, but is preferably the Internet. The communications interface may 
provide LAN, WAN, or dial-up connection to the Internet. 

The computer 2 further contains a processor (not shown) for executing software 
instructions contained on a processor-readable medium. The medium may be a storage 
device 5, such as a CD-ROM, a floppy disk, or the like, which is inserted into the 
computer 2. Alternatively, the medium may be a memory internal to the computer (not 
shown) into which the software instructions have been downloaded, such as a hard drive, 
ROM, RAM, or the like. 

Considering now in further detail the image capture subsystem 30, and with 
reference to FIG. 1, the image capture subsystem 30 requests and obtains digital images 
from an image source 20. Image sources are generally of two types. For "live" image 
sources 20a, the digital image is recorded by the image source 20a upon receipt of a 
capture signal from the image capture subsystem 30 and then received from the image 
source 20a by the image capture subsystem 30. As will be described subsequently in 
greater detail with reference to optical scanning, the image capture subsystem 30 can 
configure the image source 20a by providing image acquisition parameters appropriate for 
capturing photographic images to the source 20a. 

For "prerecorded" image sources 20b, alternatively, one or more digital images 
have already been recorded by the image source 20b, and the prerecorded image data for 
one or more digital images is received from the image source 20b by the image capture 
subsystem 30. For each digital image, the image source 20b preferably provides an image 
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acquisition date to the image capture subsystem 30. For example, where image source 
20b is a memory card 22 containing images taken by a digital camera 21, the image 
acquisition date is the date on which the picture was taken by the camera 2L In some 
embodiments in which the image source 20b processes the prerecorded images before 
transferring the image data to the image capture subsystem 30, the image capture 
subsystem 30 may provide photo settings, such as a desired pixel height and width of the 
digital image, to the image source 20b; but in the preferred embodiment the prerecorded 
image data is provided to the image capture subsystem 30 without modification. 

In addition to the image acquisition date, in some embodiments a date subsystem 
32, such as a clock/calendar or a timer, provides the image capture subsystem 30 upon 
request with the current date. Both the current date and the image acquisition date may 
also include time. As will be described subsequently in greater detail, the image capture 
subsystem 30 can use either the current date or the image acquisition date to determine the 
data folder 42 of the file system 40 in which the image date file will be stored. 

Considering now additional subsystems of a preferred embodiment of the image 
processing system 10, and with reference to FIGS. 1 and 3, the image processing system 
10 preferably includes an image management subsystem 50 coupled to the image capture 
subsystem 30 and the file system 40. The image management subsystem 50 provides for 
viewing on a monitor of the computer 2 the data folders in the file system 40, such as 
exemplary data folders 42a-b, and for viewing the image files in a specified data folder 
42a-b. An exemplary view 60 illustrates data folders 42a-b in a folder window 62, and 
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thumbnail views of image files 64a-b in a file window 66. Image files 64a-b are contained 
in the data folder 42b named "Aug 2001", as indicated by the "open folder" icon 68 
adjacent to folder "Aug 2001" 42b in the folder window 62. The image management 
subsystem 50 obtains the data folders and image files from the file system 40 by supplying 
a pathname or the like to the file system 40, as known to those skilled in the art. The 
thumbnail view typically is the most convenient one for allowing the user to quickly and 
easily identify images of interest. However, instead of thumbnail views, the image 
management subsystem 50 may alternatively display textual information about the image 
files in the specified folder 42a-b, which may be done in a more compact manner and thus 
allow more files to fit in the file window 66. 

The image management subsystem 50 further signals the image capture subsystem 
30 to acquire images from the image source 20. This signaling is typically provided in 
response to a user input such as operation of the "Scan" control 70a or the "Card Upload" 
control 70b (buttons on program). In this exemplary configuration, operation of the 
"Scan" control 70a results in the image management subsystem 50 generating a capture 
command to the image capture subsystem 30, which in turn issues a capture signal to a 
"live" image source 20a such as scanner 24 or the optical scanner subsystem of 
multifunction printer 25. In some embodiments, image acquisition parameters to be used 
by the image source 20a in acquiring the image are also communicated to the source 20a. 
These image acquisition parameters include predefined settings which are appropriate to a 
photographic image. 
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In an alternate embodiment, an external capture signal may be supplied to the 
image source 20 in order to acquire an image or images. Where the image source is a 
"live" image source 20a such as scanner 24 or the optical scanner subsystem of 
multifunction printer 25, the external capture signal is typically generated by the user 
5 operating a control, such as a pushbutton, of the live image source 20a. 

With regard to acquiring images from the "prerecorded" image source 20b, 
operation of the "Card Upload" control 70b results in the image management subsystem 
**% 50 acquiring the prestored images from "prerecorded" image source 20b, which is 

5 preferably memory card 22. As will be described subsequently in greater detail, the image 

?U 10 capture subsystem 30 automatically stores each digital image obtained from image source 
H 20a-b on the file system 40. Each digital image is stored on the file system 40 as an image 

L ? file located in a data folder associated with either the current date or the image acquisition 

ffj date. In some "prerecorded" image source 20b embodiments which further process the 

13 stored image prior to sending it to the image capture subsystem 30, the image acquisition 

.p,., 

15 parameters used by the image source 20b in further processing the stored image are also 
communicated to the source 20b. These image acquisition parameters include predefined 
settings which are appropriate to a photographic image. 

Some embodiments of the image processing system 10 also include a post- 
processing subsystem 80 coupled to the image management subsystem for post-processing 

20 at least one selected one of the image files. The post-processing system 80 is preferably 
an application program executable by the processor of computer 2. An exemplary 
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application program is a photo editor which polishes the image as requested by post- 
processing inputs from a user. Such image polishing typically include enhancing the image 
by cropping or adjusting brightness or color. Operation of a post-processing system 80 
such as the photo editor is preferably invoked by a user input to the image management 
system 50 such as the operation of a "Photo Editor" control 82. The image management 
system 50 may provide the pathname of the image file and/or the image file itself to the 
post-processing system 80. Some embodiments of the post-processing system 80 are 
coupled to the file system 40 for accessing image files. After post-processing has been 
performed, the post-processing subsystem 80 may store the modified image file on the file 
system 40, or provide the modified image file to the image management subsystem 50 for 
storage on the file system 40. 

Other exemplary post-processing subsystems 80 include creative printing 
applications such as a greeting card generation program which includes digital images on 
the greeting card; photo album applications which create photo albums from a collection 
of digital images; e-mail programs which incorporate digital images into e-mail messages; 
photo web site upload utilities which store digital images on photo-sharing web sites; fax 
programs which fax digital images to specified telephone recipients; and the like. 

The image processing system 10 may further include an image destination 84 for 
receiving output data representing processed images from a post-processing subsystem 80. 
The destination may include a peripheral device such as a printer 6, the printing subsystem 
of multifunction printer 25, or an interface connection to network 8. 
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Another embodiment of the present invention, as best understood with reference to 
FIG. 4, is a method of automatically organizing digital images. The method 100 begins at 
102 with acquiring a digital image. The image is preferably acquired from an image 
source 20. 

At 104, a date is automatically associated with the digital image. One preferred 
date is the capture date when the digital image was captured by the image source 20. 
Another preferred date is the storage date when the digital image was converted into a 
data file in the folder 42 on the file system 40. 

At 106, the digital image is automatically converted into a data file. 

At 108, the data file is stored into a data folder, such as folder 42, of a file system 
40. The folder 42 is associated with the date, and typically selected from a set of data 
folders. If no folder 42 associated with the date as yet exists on the file system 40, such a 
folder 42 is created. In the preferred embodiment, the data folder is associated with a 
particular month and year, such as folder 42a for July 2001 and folder 42b for August 
2001. For example, for a particular digital image that has a capture date of July 15, 2001 
and a storage date of August 23, 2001, if the associated date is the capture date, the image 
file will be stored into the July 2001 folder 42a; alternatively, if the associated date is the 
storage date, the image file will be stored into the August 2001 folder 42b. Such a folder 
organization advantageously organizes the digital images by date, thus helping the user to 
easily and quickly locate desired images for viewing or post-processing. 
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If more images are to be acquired ("Yes" branch of 1 10), then the method 
branches to 102 to acquire these images. If no more images are to be acquired ("No" 
branch of 1 10) and no post-processing of images is to be done ("No" branch of 1 12), then 
the method ends. If post-processing of images is to be done ("Yes M branch of 112), then 
5 at 1 14 a post-processing operation is performed on selected data files stored on the file 
system 40. Some exemplary post-processing operations associated with the method 100 
have heretofore been described with reference to the post-processing subsystem 80. 

In the preferred embodiment, the image processing system 10 includes processor- 
executable software instructions to implement method 100. These software instructions 
10 are included in one or more processor-readable media located in computer 2 and/or printer 
6. In some embodiments, the software instructions are supplied to computer 2 from 
storage device 5 

Considering now in further detail the multifunction printer 25, and with reference 
to FIG. 5, printer 25 includes an optical scanner portion 90. This portion 90 is also 

15 functionally and structurally similar to optical scanner 24. In the preferred embodiment, 
the scanner portion 90 is a flatbed scanner. In a flatbed scanner, a target item 91 to be 
scanned is placed on (or in alternate embodiments automatically fed to) a large horizontal 
glass or transparent plastic window or platen 92. The platen 92 preferably provides a 
scannable area of 8.5 inches by 1 1 inches or greater, and can accommodate target items 91 

20 which are up to the size of the platen 92. The target item 91 is typically a photograph on a 
single sheet of media such as photographic paper, but could also be a transparency, a 
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photo bound in a book, or a substantially flat physical object that is placed on the platen 
92. In a flatbed scanner, the target item 91 is maintained in a stationary position during 
scanning. 

A light source 96 is directed toward the target item 91 while an optical scanning 
5 array 94 that extends across the entire width of the platen 92 reciprocates longitudinally 
over the target item 9 1 . Preferably the light source 96 is mounted so as to be movable 
with the scanning array 94. The light source 26 may be defined by a tubular fluorescent 
p§ light, for example. The array 94 detects light reflected from the target item during 
^0 reciprocation in order to generate a digital image of the target item 91 . The array 94 may 

fU 10 be an array of photo detectors or charge coupled device (CCD) elements which define 

I ft 

fi imaging pixels and are able to generate signals indicative of the different colors that were 
f% detected at different locations of the scanned target item 91. The scanner-portion 90 
f y further includes a motor 98 to move the scanning array 94 and light source 96 together 
£3 along the scanning path, typically by driving a belt or chain 99. The motor 98 is preferably 
15 a stepper motor, which can be controlled to a high positional accuracy. 

In an alternate embodiment, the optical scanner portion 90 is a sheet-fed scanner. 
A sheet-fed scanner differs from a flatbed scanner in that the scanning array 94 is 
stationary in a sheet-fed scanner, and the target item 91 (which is typically limited to a 
single sheet of media) is moved past the array 94. 
20 Considering now in further detail the acquiring 102 of the digital image from the 

image source 20, with reference to FIG. 6 and bearing in mind the preceding discussion of 



Patent Application 
10019417 



- 14- 

the optical scanner portion 90, the acquiring 102 determines at 122 the type of image 
acquisition to be performed. If the image to be acquired is from a "live" image source 20a 
such as the optical scanner portion 90 ("Live" branch of 122), then at 124 settings 
appropriate to a photographic image for image acquisition parameters are predefined. At 
126, a digital image is captured with the image source 20a according to the predefined 
settings. Typical predefined settings will be described subsequently. Where the image 
source 20a is the optical scanner portion 90 or the optical scanner 24, the target item 91 
(which is positioned image side down on the platen 92) is optically scanned using the 
predefined settings to form the digital image of the target item 9L At 128, the digital 
image is uploaded and acquiring 102 completes. 

If the image to be acquired has already been captured ("Pre-Recorded" branch of 
122), then at 130 it is determined whether image preprocessing will be performed before 
the acquisition. If the "prestored" image source 20b is capable of image preprocessing and 
image preprocessing is to be performed ("Yes" branch of 130), then at 132 the previously 
captured image is preprocessed using predefined settings appropriate to a photographic 
image for the image acquisition parameters. After the preprocessing 132, or if no 
preprocessing is to be performed ("No" branch of 130), then at 134 the previously 
captured digital image is uploaded and the acquiring 102 completes. In embodiments 
where the "prestored" image source 20b is capable of providing information other than 
digital images, the uploading 134 may include uploading this additional information (and 
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typically storing it on the file system 40 as a non-image file), or alternatively may include 
filtering out the additional information so that only images are uploaded. 

Considering now in greater detail the predefined settings for image acquisition 
parameters, and with reference to FIG. 7, each different type of image source 20 may have 
5 different parameters and/or different settings for those parameters. For an optical scanner 
portion 90 of a multifunction printer 25, or for an optical scanner 24, a preferred set of 
image acquisition parameters 140 include a pixel depth parameter 142, an image resolution 
^ parameter 144, a crop mode parameter 146, and a skew correction mode parameter 148. 
In Preferred settings for these parameters appropriate to photographic images include a pixel 

3*." 

[U 10 depth 142 of 24-bit color, an image resolution 144 of 150 dots per inch (dpi), a crop mode 

iff 

O 146 of automatic border detection, and a skew correction mode 148 of automatic image 

■L straightening. These settings cooperate to allow a digital image of a target item 9 1 placed 

*n on the platen 92 to be converted into a photographic-quality image file without requiring 

; ^! 

P manual user intervention, such as a preview scan and subsequent interactive tweaking of 
15 various image parameters, before the photographic-quality image file is produced. Use of 
the predefined image acquisition parameter settings thus allows image scanning to be 
performed in a one-step operation that is analogous to how a digital image is captured 
with a H point-and-shoot" digital camera. 

From the foregoing it will be appreciated that the image processing system and 
20 methods provided by the present invention represent a significant advance in the art. 
Although several specific embodiments of the invention have been described and 



Patent Application 
10019417 



- 16- 

illustrated, the invention is not limited to the specific methods, forms, or arrangements 
parts so described and illustrated. The invention is limited only by the claims. 



